A Retrospective Analysis of Medical Student Performance Evaluations, 2014-2020: Recommend with Reservations.

BACKGROUND: The Medical Student Performance Evaluations (MSPE) is a cornerstone of residency applications. Little is known regarding adherence to Association of American Medical Colleges (AAMC) MSPE recommendations and longitudinal changes in MSPE content. OBJECTIVES: Evaluate current MSPE quality and longitudinal changes in MSPE and grading practices. DESIGN: Retrospective analysis. PARTICIPANTS: Students from all Liaison Committee on Medical Education (LCME)-accredited medical schools from which the Stanford University Internal Medicine residency program received applications between 2014-2015 and 2019-2020. MAIN MEASURES: Inclusion of key words to describe applicant performance and metrics thereof, including distribution among students and key word assignment explanation; inclusion of clerkship grades, grade distributions, and grade composition; and evidence of grade inflation over time. KEY RESULTS: MSPE comprehensiveness varied substantially among the 149 schools analyzed. In total, 25% of schools provided complete information consistent with AAMC recommendations regarding key word/categorization of medical students and clerkship grades in 2019-2020. Seventy-seven distinct key word terms appeared across the 139 schools examined in 2019-2020. Grading practices markedly varied, with 2-83% of students receiving the top internal medicine clerkship grade depending on the year and school. Individual schools frequently changed key word and grading practices, with 33% and 18% of schools starting and/or stopping use of key words and grades, respectively. Significant grade inflation occurred over the 6-year study period, with an average 14% relative increase in the proportion of students receiving top clerkship grades. CONCLUSIONS: A minority of schools complies with AAMC MSPE guidelines, and MSPEs are inconsistent across time and schools. These practices may impair evaluation of students within and between schools.

Do I Belong Here? Confronting Imposter Syndrome at an Individual, Peer, and Institutional Level in Health Professionals.

Introduction: Imposter syndrome (IS) is a feeling of being an intellectual fraud and is common among health professionals, particularly those underrepresented in medicine. IS is accompanied by burnout, self-doubt, and beliefs of decreased success. This workshop aims to discuss the impact of IS and develop strategies to confront IS at the individual, peer, and institutional levels. Methods: During the 75-minute interactive workshop, participants listened to didactics and engaged in individual reflection, small-group case discussion, and large-group instruction. Workshop participants and facilitators included medical students, residents, fellows, faculty, staff, and program leadership. Anonymous postworkshop evaluations exploring participants' satisfaction and intentions to change their behavior were collected. Descriptive statistics were used to analyze the quantitative data, and content analysis was used to analyze participants' intentions to change their behavior. Results: The workshop was presented at three local academic conferences and accepted at one national conference. Data were collected from 92 participants. Ninety-two percent of participants felt the workshop met its objectives, and 90% felt the workshop was a valuable use of their time. Furthermore, 90% of participants stated they would apply information learned at the workshop in the future. The participants indicated an intent to change behavior on individual, peer, and institutional levels, while recognizing that barriers exist at all those levels. Discussion: This workshop proved to be an effective means to discuss strategies on how to address IS at the individual, peer, and institutional levels. The materials can be adapted for relevance to various audiences.

The COVID-19 Pandemic as an Opportunity for Operational Innovation at 2 Student-Run Free Clinics.

The onset of the COVID-19 pandemic and subsequent county shelter-in-place order forced the Cardinal Free Clinics (CFCs), Stanford University's 2 student-run free clinics, to close in March 2020. As student-run free clinics adhering to university-guided COVID policies, we have not been able to see patients in person since March of 2020. However, the closure of our in-person operations provided our student management team with an opportunity to innovate. In consultation with Stanford's Telehealth team and educators, we rapidly developed a telehealth clinic model for our patients. We adapted available telehealth guidelines to meet our patient care needs and educational objectives, which manifested in 3 key innovations: reconfigured clinic operations, an evidence-based social needs screen to more effectively assess and address social needs alongside medical needs, and a new telehealth training module for student volunteers. After 6 months of piloting our telehealth services, we believe that these changes have made our services and operations more robust and provided benefit to both our patients and volunteers. Despite an uncertain and evolving public health landscape, we are confident that these developments will strengthen the future operations of the CFCs.

Outcomes From a Novel Graduate Medical Education Leadership Program in Advancing Diversity, Equity, and Inclusion.

BACKGROUND: Academic medicine needs more diverse leadership from racial/ethnic minorities, women, people with disabilities, and LGBTQIA+ physicians. Longitudinal structural support programs that bring together underrepresented in medicine (UiM) and non-UiM trainees are one approach to build leadership and scholarship capacity in diversity, equity, and inclusion (DEI). OBJECTIVE: To describe the creation, satisfaction with, and feasibility of a Leadership Education in Advancing Diversity (LEAD) Program and evaluate scholars' changes in self-efficacy, intended and actual behavior change, and outputs in leadership and DEI scholarship. METHODS: In 2017, we created the LEAD Program, a 10-month longitudinal, single institution program that provides residents and fellows ("scholars") across graduate medical education (GME) with leadership training and mentorship in creating DEI-focused scholarship. In the first 3 cohorts (2017-2020), we assessed scholars' self-efficacy, actual and planned behavior change, and program satisfaction using IRB-approved, de-identified retrospective pre-/post-surveys. We measured scholarship as the number of workshops presented and publications developed by the LEAD scholars. We used descriptive statistics and paired 2-tailed t tests to analyze the data. RESULTS: Seventy-five trainees completed LEAD; 99% (74 of 75) completed the retrospective pre-/post-surveys. There was statistically significant improvement in scholars' self-efficacy for all learning objectives. All trainees thought LEAD should continue. LEAD scholars have created workshops and presented at local, regional, and national conferences, as well published their findings. Scholars identified the greatest benefits as mentorship, developing friendships with UiM and ally peers outside of their subspecialty, and confidence in public speaking. CONCLUSIONS: LEAD is an innovative, feasible GME-wide model to improve resident and fellow self-efficacy and behaviors in DEI scholarship and leadership.

Preclinical curriculum of prospective case-based teaching with faculty- and student-blinded approach.

BACKGROUND: Case-based teaching with real patient cases provides benefit of simulating real-world cognition. However, while clinical practice involves a prospective approach to cases, preclinical instruction typically involves full disclosure of case content to faculty, introducing hindsight bias into faculty teaching in medical curricula. METHODS: During 2015-2018, we piloted an optional medical school curriculum involving 6-7 one-hour sessions over a 3-month period each year. New groups enrolled each year from first- and second-year classes. A facilitator provided a blinded physician discussant and blinded students with case information during and not in advance of each session, allowing prospective case-based discussions. Cases were based on real patients treated in the Department of Medicine. Clinical material was presented in the chronologic sequence encountered by treating physicians. Content covered a median of 5 patient visits/case (range: 2-10) spanning over months. A 14-item survey addressing components of the reporter-interpreter-manager-educator (RIME) scheme was developed and used to compare self-reported clinical skills between course participants and non-participant controls during the 2016 course iteration. RESULTS: This elective curriculum at Stanford School of Medicine involved 170 preclinical students (22.7% of 750 eligible). During the 2016 course iteration, a quasi-experimental study compared self-reported clinical skills between 29 course participants (response rate: 29/49 [59.2%]) and 35 non-participant controls (response rate: 35/132 [26.5%]); students self-assessed clinical skills via the RIME-based survey developed for the course. Two-sample t-tests compared the change in pre- and post-course skills between course participants and non-participants. Of 15 Department of Medicine faculty members invited as discussants, 12 (80%) consented to participate. Compared with controls, first-year participants self-assessed significantly greater improvement in understanding how clinicians reason through cases step-by-step to arrive at diagnoses (P = 0.049), work through cases in longitudinal settings (P = 0.049), and share information with patients (P = 0.047). Compared with controls, second-year participants self-assessed significantly greater improvement (P = 0.040) in understanding how clinicians reason through cases step-by-step to arrive at diagnoses. CONCLUSIONS: Prospective case-based discussions with blinding of faculty and students to clinical content circumvents hindsight bias and may impart real-world cognitive skills as determined by student self-report.

Immersion medicine programme for secondary students.

BACKGROUND: Although the proportion of ethnicities representing under-represented minorities in medicine (URM) in the general population has significantly increased, URM enrolment in medical schools within the USA has remained stagnant in recent years. METHODS: This study sought to examine the effect of an immersion in community medicine (ICM) programme on secondary school students' desire to enter the field of medicine and serve their communities. The authors asked all 69 ICM alumni to complete a 14-question survey consisting of six demographic, four programme and four career questions, rated on a Likert scale of 1 (completely disagree) to 5 (completely agree), coupled with optional free-text questions. Data were analysed using GraphPad prism and nvivo software. RESULTS: A total of 61 students responded, representing a response rate of 88.4 per cent, with a majority of respondents (73.7%) from URM backgrounds. An overwhelming majority of students agreed (with a Likert rating of 4 or 5) that the ICM programme increased their interest in becoming a physician (n = 56, 91.8%). Students reported shadowing patient-student-physician interactions to be the most useful (n = 60, 98.4%), and indicated that they felt that they would be more likely to lead to serving the local community as part of their future careers (n = 52, 85.3%). Of the students that were eligible to apply to medical school (n = 13), a majority (n = 11, 84.6%) have applied to medical school. URM enrolment in medical schools within the USA has remained stagnant in recent years DISCUSSION: Use of a community medicine immersion programme may help encourage secondary students from URM backgrounds to gain the confidence to pursue a career in medicine and serve their communities. Further examination of these programmes may yield novel insights into recruiting URM students to medicine.

Hand hygiene of medical students and resident physicians: predictors of attitudes and behaviour.

OBJECTIVES: We measured medical students' and resident trainees' hand hygiene behaviour, knowledge and attitudes in order to identify important predictors of hand hygiene behaviour in this population. METHODS: An anonymous, web-based questionnaire was distributed to medical students and residents at Stanford University School of Medicine in August of 2012. The questionnaire included questions regarding participants' behaviour, knowledge, attitude and experiences about hand hygiene. Behaviour, knowledge and attitude indices were scaled from 0 to 1, with 1 representing superior responses. Using multivariate regression, we identified positive and negative predictors of superior hand hygiene behaviour. We investigated effectiveness of interventions, barriers and comfort reminding others. RESULTS: 280 participants (111 students and 169 residents) completed the questionnaire (response rate 27.8%). Residents and medical students reported hand hygiene behaviour compliance of 0.45 and 0.55, respectively (p=0.02). Resident and medical student knowledge was 0.80 and 0.73, respectively (p=0.001). The attitude index for residents was 0.56 and 0.55 for medical students. Regression analysis identified experiences as predictors of hand hygiene behaviour (both positive and negative influence). Knowledge was not a significant predictor of behaviour, but a working gel dispenser and observing attending physicians with good hand hygiene practices were reported by both groups as the most effective strategy in influencing trainees. CONCLUSIONS: Medical students and residents have similar attitudes about hand hygiene, but differ in their level of knowledge and compliance. Concerns about hierarchy may have a significant negative impact on hand hygiene advocacy.

Mortality risk among recent-onset injection drug users in five U.S. cities.

To quantify the risk of death among recent-onset (< 5 years) injection drug users, we enrolled 2089 injection drug users (IDUs) age

Multilevel community-based intervention to increase access to sterile syringes among injection drug users through pharmacy sales in New York City.

OBJECTIVES: Research has indicated that there is minimal use of pharmacies among injection drug users (IDUs) in specific neighborhoods and among Black and Hispanic IDUs. We developed a community-based participatory research partnership to determine whether a multilevel intervention would increase sterile syringe access through a new policy allowing nonprescription syringe sales in pharmacies. METHODS: We targeted Harlem, NY (using the South Bronx for comparison), and disseminated informational material at community forums, pharmacist training programs, and counseling or outreach programs for IDUs. We compared cross-sectional samples in 3 target populations (pre- and postintervention): community members (attitudes and opinions), pharmacists (opinions and practices), and IDUs (risk behaviors). RESULTS: Among community members (N = 1496) and pharmacists (N = 131), negative opinions of IDU syringe sales decreased in Harlem whereas there was either no change or an increase in negative opinions in the comparison community. Although pharmacy use by IDUs (N=728) increased in both communities, pharmacy use increased significantly among Black IDUs in Harlem, but not in the comparison community; syringe reuse significantly decreased in Harlem, but not in the comparison community. CONCLUSIONS: Targeting the individual and the social environment through a multilevel community-based intervention reduced high-risk behavior, particularly among Black IDUs.